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Background: The urinary iodine micromethod (UIIVIM) is a modification of the conven- 
tional method and its performance needs evaluation. 

Methods: UIMM performance was evaluated using the method validation and 2008 Iodine 
Deficiency Disorders survey data obtained from four urinary iodine (Ul) laboratories. 
Method acceptability tests and Sigma quality metrics were determined using total allow- 
able errors (TEaS) set by two external quality assurance (EQA) providers. 

Results: UIMM obeyed various method acceptability test criteria with some discrepancies 
at low concentrations. Method validation data calculated against the Ul Quality Program 
(TUIQP) TEaS showed that the Sigma metncs were at 2.75, 1.80, and 3.80 for 51 + 15.50 
Mg/L, 108+32.40 [ig/l, and 149 + 38.60 |jg/L Ul, respectively External quality control (EQC) 
data showed that the performance of the laboratories was within Sigma metrics of 0.85- 
1.12, 1.57-4.36, and 1.46-4.98 at 46.91 + 7.05 Mg/L, 135.14+13.53 Mg/L, and 238.58+17.90 
Mg/L, respectively No laboratory showed a calculated total error (TEcaic)<total allowable er- 
ror (TEa) for the low concentration level; all laboratories showed an acceptable perfor- 
mance for the medium-high level, and two laboratories showed an acceptable perfor- 
mance for the high level. When calculated against the Ensuring the Quality of Ul Proce- 
dures (EQUIP) TEaS, the performance of all laboratories was<2.49 Sigma metncs at all 
concentrations. Only one laboratory had TEcaic<TEa for the medium-high and high con- 
centrations. 

Conclusions: UIMM showed unacceptable performance for the iodine deficiency levels 
and variable performance at other concentrations according to different TEaS. 

Key Words: Urinary iodine. Method evaluation, Sigma metrics, Quality control, Method ac- 
ceptability 
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INTRODUCTION 

The WHO had targeted iodine deficiency disorders (IDD) as a 
disease that needs to be alleviated worldwide. IDD is manifested 
by goiter and hypothyroidism in people of all age groups; other 
manifestations include spontaneous abortion, perinatal mortality 



and stillbirth in fetuses, and impaired mental function and cre- 
tinism in children and adolescents [1]. Until the year 2006, of 
the 130 countries that had performed the IDD survey, 47 coun- 
tries still had iodine-deficient regions. It was estimated that ap- 
proximately 31% of the world population had inadequate iodine 
diets, and the most affected areas were in Southeast Asia and 
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Europe [2]. The most effective way to increase iodine content in 
tlie diet is througli a universal salt iodization (USD strategy tinat 
involves iodization of salt used by humans, livestock, and food 
industries. It is considered safe, cost-effective, and sustainable; 
many developed countries have successfully adopted the pro- 
gram. To determine the iodine status or for monitoring the USI 
program in a population, the median uhnary iodine (mUl) val- 
ues are determined because urinary iodine (Ul) is considered 
the most immediate indicator of current iodine intai<e [2, 3]. The 
mUl values are classified as follows: <20 pg/L for severe iodine 
deficiency; 20-49 pg/Lfor moderate iodine deficiency; 50-99 pg/ 
L for mild iodine deficiency; 100-199 pg/L for adequate iodine 
nutrition; 200-299 pg/L for a slight risl< of more than adequate 
intake in the overall population but likely to provide adequate in- 
take for pregnant/lactating women; and >300 pg/Lfor excessive 
risk of adverse health consequences that include iodine-in- 
duced hyperthyroidism and autoimmune thyroid diseases [2]. 

In Malaysia, duhng the national IDD survey in 1996 and sev- 
eral subsequent studies, Sabah and some rural parts of Sar- 
awak and Peninsular Malaysia were identified as iodine-defi- 
cient regions [4-6]. In 1999, USI was enacted in Sabah, while io- 
dine was added to dhnking water piped into a few parts of Sar- 
awak, Kedah, Kelantan, Perak, and Terengganu [7]. Ul had 
been tested for health monitoring purposes in these regions at 
the IDD laboratories of the Ministry of Health (MOH) by using 
glass test tubes and by digestion using chloric acid and reaction 
through the Sandell-Kolthoff reaction [8], which is catalyzed by 
iodine to reduce eerie ammonium sulfate (yellow in color) to the 
cerous form (colorless) [2]. In 2006, the Institute for Medical Re- 
search (IMR) modified the Ul quantification method with an ap- 
plication of ammonium persulfate as the digestion agent [9]. Al- 
though the digestion was performed in glass test tubes, the 
Sandell-Kolthoff reaction was carried out in 96-well polystyrene 
microtiter plates. Thus, the advantages in safety, faster turn- 
around-time, and reduction in chemical waste and labor costs 



were achieved. The method thus developed, named the "uri- 
nary iodine micromethod" (UIMM) [10] was a modification of 
the standard WHO Ul quantification method [3] and the method 
developed earlier by Ohashi et al. [11]. UIMM was modified to 
better fit the limited facilities in small- to medium-scale clinical 
laboratories with only minor expenditures on additional instru- 
ments or consumables. UIMM has now been used for 6 yr in 
the MOH IDD laboratohes and for Ul quantification duhng the 
2008 national IDD survey. However, there is a need to evaluate 
the peri'ormance of the UIMM. 

Sigma quality metrics have been applied to evaluate the per- 
formance of clinical chemistry tests since the early 2000s [12]. 
The metrics list 6 Sigma as "world class," 5 Sigma as "excel- 
lent," 4 Sigma as "good," 3 Sigma as "acceptable," 2 Sigma as 
"poor," and 1 Sigma as "unacceptable." In this study, the total 
allowable errors (TEaS) in Table 1 as recommended by the exter- 
nal quality assurance (EQA) providers were used to calculate 
the Sigma methcs [12]. Total errors for the Ul testing in all MOH 
IDD laboratories were also monitored. The UIMM evaluation 
was undertaken to identify weaknesses to strategize the internal 
quality control (IQC) to minimize false negatives and maximize 
error detection [12]. Ultimately, our goal was to improve labora- 
tory quality management to increase precision and accuracy of 
the results. 

METHODS 

1. Data 

The IQC and external quality control (EQC) data were obtained 
from the records of Ul assays performed during the 2006 method 
validation study and the 2008 IDD national survey EQC data. 

2. Urine samples 

1) For the method validation data 

Three IQC urine samples were pooled to estimate the Medium- 



Table 1. Total allowable errors (TEaS) set by two urinary iodine (Ul) external quality assurance (EQA) providers 

Ul range 



Low (L) 



Medium-Low (M-L) Medium-High (M-H) 



Hieiil 



EQA Program (iJg/L) 

TUIQP (%) 
EQUIP (%) 



<50 

30 
30 



50-100 

TEa 

30 
25 



100-200 

30 
20 



200-300 

30 
15 



Reference method 

Micromethod [11] 

Inductively coupled plasma 
mass spectrometiy (ICP-MS) 



Abbreviations: TUIQP, The Urinary Iodine Quality Program, Institute for Clinical Pathology and Medical Research, Australia; EQUIP, Ensuring the Quality of 
Urinary Iodine Procedures program, Centre for Disease Control, USA. 
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Low (M-L), Medium-High 1 (M-Hl), and Medium-High 2 (M- 
H2) Ul levels (Table 1). The IQC samples comprised M-L (target 
value: 51 + 15.50 pg/L), M-Hl (target value: 108±32.40 |jg/L), 
and M-H2 (target value: 149+38.60 |jg/L) levels, interassay CVs 
were analyzed at IMR (n = 10). 

2) For the 2008 national IDD survey EQC data 
Three EQA reference materials were requested from the pro- 
vider of the Urinary Iodine Quality Program (TUIQP) at the In- 
stitute for Clinical Pathology and Medical Research (ICPMR) in 
Australia, which were used as EQCs for the Ul assays and were 
assayed intermittently. The EQC samples were comprised of L 
(target value: 46.91 + 13.52 pg/L), M-H (target value: 135.14 + 
7.06 Mg/L), and H (target value: 238.58 + 17.89 pg/L) levels (Ta- 
ble 1), and they were analyzed in four IDD laboratories (Lab A 
[n = 20]. Lab B [n = 18]. Lab C [n = 12], and Lab D [n = 6]). IQC 
samples were obtained from pooled urine samples prepared 
separately in each laboratory. The 2008 national IDD survey was 
approved by the Medical Research and Ethics Committee, 
MQH, Malaysia. 

3. Participating laboratories 

All Ul laboratohes within the MQH, namely, IMR, National Pub- 
lic Health Laboratory, Ipoh Public Health Laboratory, and Sabah 
Public Health Laboratory, participated in this study by running 
the Ul tests on the 2008 national IDD survey samples together 
with the IQC and EQC samples. 



4. UIMM test 

Aliquots (250 pL) of potassium iodate standards, IQC samples, 
and EQC samples were put in glass test tubes and were mixed 
with 1 mL 1 M ammonium persulfate. The mixtures were incu- 
bated for 1 hr at 100°C and were cooled to room temperature. 
Thirty microliters of each digested standard, control, and EQC 
sample was pipetted into a 96-well flat-bottomed polystyrene 
microliter plate, and 60 |jL arsenious acid solution was added to 
the wells. The microliter plate was tapped gently before 30 |jL 

0. 019 M eerie ammonium sulfate was added into the wells. The 
plate was then incubated at room temperature for 30 min on an 
orbital microplate shaker; thereafter, absorbance was read at 
405 nm by using a microplate reader [10]. 

5. Data analyses 

All formula and charts used in the determination of bias, CV, 
SD, calculated total error (TEcaic), and the Sigma metrics values 
were obtained from the published literature [12, 13]. TEcaic val- 
ues were then compared to TEaS values shown in Table 1. The 
normalized method decision chart was used to depict the Sigma 
metrics. Spline curves were plotted using Multicalc 2000 soft- 
ware (Perkin Elmer, Waltham, MA, USA) or the software in- 
cluded with the microplate reader (MRX™, DYNEX Technologies 
Inc., Chantilly, VA, USA). 

RESULTS 

1. Evaluation of UIMM using method validation data 

For the method acceptability test chteria check (Table 2), it is 



Table 2. The method acceptability tests results on standard deviations and errors from the method validation data with criteria check 
against two EQA providers total allowable errors (TEaS) 



Method 

acceptability 

tests 


U 




Compared to TUIQP TEa 






Compared to EQUIP TEa 




1 control range 


Method 


Obeys criteria 




Method acceptability criteria 


Obeys criteria 


M-L(%) M-L(%) M- 


-L(%) 


acceptability 
criteria 


M-L M-Hl 


M-H2 




M-H2 

(%) 


M-L M-Hl M-H2 


S w-mn 


17.86 


6.11 


6.46 


< 0.25 TEa 
{<7.5%) 


No Yes 


Yes 


<6.25 <5.00 


<5.00 


No No No 


Stilt 


13.86 


9.77 


7.67 


< 0.33 TEa 
(<9.9%) 


No Yes 


Yes 


<8.25 <6.60 


<6.60 


No No No 


SE (inaccuracy) 


2.48 


2.30 


3.48 














RE (imprecision) 


10.00 


15.00 


7.00 














TEcaic (SE+z*SD) 


22.48 


32.30 


17.48 


< TEa 

(<30%) 


Yes No 


Yes 


<25 <20 


<20 


Yes No Yes 


Abbreviations: S w-mn, within-run standard deviation; S tot, total standard deviation; SE, systematic error; RE, random error; TEcaic, calculated total error; z, mul- 
tiplier representing desired confidence interval; TUIQP, The Urinary Iodine Quality Program, Institute for Clinical Pathology and Medical Research, Australia; 
EQUIP, Ensuring the Quality of Urinary Iodine Procedures program, Centre for Disease Control, USA. 
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Table 3. The method acceptability tests results on t-value and method comparison study from the method validation data 



Method acceptability tests 



Results Method acceptability criteria 



Indication 



t-value 
(bias) 

sd/Vn 
Vl(yi-Yi)^ 

N-2 
y-intercept 
Slope 

Correlation coefficient (r^) 



-0.0296 



18.15 

4.6213 
0.9342 

0.9246 



0 (ideal) 

0 (ideal) 
0 
1 

1 



SE is 0.0296 times less than the RE 



SyA indicates the mean distance of the data points from the best-fit curve 

Indication of constant SE 

Indication of proportional SE 

The urinary iodine method in test tubes explains 92.46% 
of the variance in UIMM; 7.54% is the error 



Statistical formula definition are as stated in the reference [13]. 

Abbreviations: SE, systematic error; RE, random error; UIMM, urinary iodine micromethod. 

Table 4. Reportable range worksheet for quantifying errors from the method validation linearity study 



Pool or Mixture 


Mean 
(Y) 


Theoretical 
(X) 


Bias 
(Y-X) 


% Error 


Method 
acceptability criteria 
(%Error<TUIQPTEa) 


Obeys 
criteria? 


Method 
acceptability criteria 
(%Error< EQUIP TEa) 


Obeys 
criteria? 


100% low pool 


57.22 


51.00 


6.22 


12.20 


< 30% 


Yes 


<30% 


Yes 


75% Low pool+25% High pool 


81.18 


75.50 


5.68 


7.52 


< 30% 


Yes 


<25% 


Yes 


50% Low pool+50% High pool 


123.59 


100.00 


23.59 


23.59 


< 30% 


Yes 


<25% 


Yes 


25% Low pool-i-75% High pool 


140.04 


124.50 


15.54 


12.48 


< 30% 


Yes 


<20% 


Yes 


100% High pool 


169.10 


149.00 


20.10 


13.49 


< 30% 


Yes 


< 15% 


Yes 



Abbreviations: TUIQP, The Urinary Iodine Quality Program, Institute for Clinical Pathology and Medical Research, Australia; EQUIP, Ensuring the Quality of 
Urinary Iodine Procedures program. Centre for Disease Control, USA. 
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Fig. 1. Urinary iodine micromethod's normalized method decision 
chart against The Urinary Iodine Quality Program (TUIQP) TEaS 
based on the 2008 National IDD Survey EQA results (Lab A 
[n = 20], Lab B [n = 18], Lab C [n = 12], and Lab D [n=6]) and the 
2006 method validation study (MV). According to urinary iodine 
ranges in Table 1. 

Abbreviations: L, low control; M-L, medium-low control; M-H, medium-high 
control; H, high control. 



shown that by comparing to the TUIQP TEa, the M-H2 control 
obeyed all criteria, the M-Hl control obeyed two criteria, and 
the M-L control obeyed only 1 of 3 criteria. When compared to 
Ensuring the Quality of Urinary Iodine Procedures (EQUIP) pro- 
gram (Center for Disease Control, Atlanta, GA, USA) TEa, M-Hl 
did not obey any criteria, whereas the other two controls obeyed 
only 1 of 3 criteria. In Table 3, the UIMM also showed the pres- 
ence of constant and proportional systematic errors (SEs) and 
random error (RE). The S y/x and correlation coefficient (r^) re- 
sults also indicated the existence of SD of data points from the 
best-fit linear curve and error in the method comparison study 
[10], respectively. The errors were also quantified from the lin- 
earity study [10] (Table 4). It is shown that by comparing with ei- 
ther TUIQP or EQUIP's TEaS, the concentrations within the 10- 
190 |jg/L range obeyed all criteria. When the data was used to 
plot the normalized method decision chart (Fig. 1), the Sigma 
metrics for M-L, M-Hl, and M-H2 controls were 2.75, 1.8, and 
3.8, respectively. 

2. Evaluation of UIMM using EQCdata 

At the L, M-H, and H concentration levels, the UIMM possessed 
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Table 5. Systematic error (SE), random error (RE), and calculated total error (TEcaic) for the urinary Iodine micromethod performed by the 
four IDD laboratories duhngthe 2008 National IDD Survey (Lab A [n = 20], Lab B [n = 18], LabC [n = 12], and Lab D [n = 6]) 







Lab A 






LabB 






LabC 






LabD 






L 


M-H 


H 


L 


M-H 


H 


L 


M-H 


H 


L 


M-H 


H 


SE 


19.00 


7.32 


4.17 


17.02 


5.36 


8.63 


26.12 


11.67 


4.07 


29.44 


15.08 


6.37 


RE 


9.71 


10.00 


9.21 


10.95 


6.68 


3.06 


7.06 


5.80 


23.08 


5.07 


6.29 


20.68 


TEcalc 


38.42 


27.32 


22.59 


38.92 


18.72 


14.75 


40.24 


23.27 


50.23 


39.58 


27.66 


47.73 


IVIethod acceptability criteria 
(%Error<TUIQPTE=) 


<30 


<30 


<30 


<30 


<30 


<30 


<30 


<30 


<30 


<30 


<30 


<30 


Obeys criteria? 


No 


Yes 


Yes 


No 


Yes 


Yes 


No 


Yes 


No 


No 


Yes 


No 


IVIethod acceptability criteria 
(7oError< EQUIP TEa) 


<30 


<20 


<15 


<30 


<20 


<15 


<30 


<20 


<15 


<30 


<20 


<15 


Obeys criteria? 


No 


No 


No 


No 


Yes 


Yes 


No 


No 


No 


No 


No 


No 



Abbreviations: TUIQP, The Urinary Iodine Quality Program, Institute for Clinical Pathology and Medical Research, Australia; EQUIP, Ensuring the Quality of 



performance of the 4 laboratories were w^lthln Sigma-metrics of 

0. 85-1.12 at the L level, 1.57-4.37 at the M-H level, and 1.46- 
4.98 at the H level. Based on the EQUIP TEaS, at the same con- 
centration levels, UIMM performance was classed at Sigma 
metrics of 0.85-1.12, 0.9-2.49, and -1.98 to 1.39, respectively 
(Fig. 2). 

DISCUSSION 

The literature describes three different formats that can be used 
to determine analytical quality in clinical chemistry, namely, al- 
lowable bias, allowable SD, and TEa. Allowable bias or Inaccu- 
racy sets the limit for SE, allowable SD or imprecision sets the 
limit for RE, and TEa sets the limit for a combination of RE and 
SE [13]. In this study, we used the UIMM evaluation method for 
applying various statistical analyses by using the method valida- 
tion and EQC data. Method validation is a process to validate a 
method's capability and acceptability [13]. The imprecision and 
bias data alone were not adequate for evaluating the perfor- 
mance of the UIMM. Thus, the normalized method decision 
chart [13] was plotted whereby the Imprecision and bias were 
normalized against the TEaS. In this study, we used the TEaS for 
Ul that had been listed by the TUIQP and EQUIP, EQA Pro- 
grams for the UIMM evaluation (Table 1). A method is consid- 
ered acceptable if the TEcaic In a method performance is less 
than the medically allowable error (TEa), which Is the required 
quality limit [13]. The calculation of the Sigma metrics Is as fol- 
lows: Sigma-metrics =(TEa-bias) / CV. 

1. Evaluation of UIMM by using method validation data 
The UIMM is acceptable when compared to the TUIQP TEa be- 



Urinary Iodine Procedures program. Centre for Disease Control, USA. 
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0 10 20 30 40 50 60 70 80 90 100 



Observed imprecision (% CV) 

Fig. 2. Urinary iodine micromethod's normalized method decision 
chart based on the 2008 national IDD survey EQA results (Lab A 
[n = 20]. Lab B [n = 18]. Lab C [n = 12], and Lab D [n = 6]) and 
against EQUIP TEaS. According to urinary iodine ranges in Table 1. 
Abbreviations: L, low control; M-H, medium-high control; H, high control. 

biases (SE or inaccuracy) of -8.20 + 2.64%, 1.14 + 8.42%, and 
-14.01+9.48%, respectively, and CVs (RE or imprecision) of 
22.89 + 5.86%, 9.86+4.37%, and 5.81+2.16%, respectively (Ta- 
ble 5). The TEcaic for the method were 38.42-40.24% for the L 
level, 18.72-27.66% for the M-H level, and 14.75-50.23% for the 
H level. According to the TUIQP TEa, none of the laboratohes 
estimated a calculated total error (TEcaic)<TEa for the L level, all 
laboratories had TEcaic<TEa for the M-H level, and 2 laboratories 
had TEcaic<TEa for the H level. According to the EQUIP TEaS, all 
laboratories had TEcaic>TEa for the L level, but one laboratory 
had TEcaic<TEa for the M-H and H levels. As shown in Fig. 1, 
based on the TUIQP TEa of 30% for all concentration levels, the 
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cause it obeys tine majority of the method acceptability test cri- 
teria (Table 2). However, when compared to the EQUIP TEa, the 
UIMM performance was considered unacceptable. Through er- 
ror quantification tests, the constant and proportional SEs and 
RE were observed, but in small magnitudes (Table 3). The S y/x 
and r^ results also showed errors but they were close to the ideal 
values, indicating acceptable performance. The linearity study 
exhibited excellent performance with errors values <TEaS (Table 
4). Linearity of the standard curve was proven for the indicated 
range of 10-190 Mg/L [10]. Curvatures were observed at low (L) 
and high (H) concentrations; hence, it was suggested that data 
integration for the concentration outside the range was per- 
formed using a spline-smoothed curve. Using the normalized 
method decision chart (Fig. 1), the performance was found to 
be poor at the M-L level (2 Sigma), unacceptable at the M-Hl 
level (1 Sigma), and marginal at the M-H2 level (3 Sigma). 

2. Evaluation of UIMM by using EQC data 

Although the number of replicates of the EQA samples from the 
4 IDD laboratories varied (Lab A [n=20], Lab B [n = 18]. Lab C 
[n = 12], and Lab D [n=6]), we still used the data because they 
were the most representative data owing to the uniformity of 
samples in all laboratories. The IQC rule of rejection of 22s and 
hs was used, and duplicates or triplicates of IQC from each level 
were included in every assay. For the assessment using the EQC 
data, the 0-200 pg/L standard curve was used in all laboratories. 

In Table 5, from the EQC data, poor accuracy (high biases) 
of>20% was observed in the L Ul level in two laboratories, and 
poor precision (high CVs) of>20% was observed in the H Ul 
level in two laboratories. Lab A and Lab B generally possessed 
satisfactory biases of<20% and CVs of<ll% for all concentra- 
tion levels. Large biases of 17.02-29.44% were observed in the 
analysis of the L Ul level compared to the M-H and H Ul levels 
in all the laboratories. These data showed that the variability and 
degree of dispersion of the Ul values in the L range (32.80-61.00 
pg/L) were the greatest. Thus, the UIMM is not applicable to 
monitor the Ul of the severe iodine-deficient human subjects 
[11]. Large CVs of 20.68-23.08% in the H level in two laborato- 
ries might be due to dilution of the samples to obtain the values 
within the 0-200 pg/L range for the standard curve. Multiplica- 
tion of the values with the dilution factor would therefore multi- 
ply the existing error in the results. For TEcaic, compared with 
TUIQP TEaS, all laboratories showed poor performance at the L 
level, whereas all laboratories showed good performance at the 
M-H level and two laboratories showed good performance in the 
H level. Compared to EQUIP TEaS, Lab B showed good perfor- 
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mance (TEcaic<TEaS) at the M-H and H Ul levels. However, the 
TEcaicS for the other laboratories weroTEaS. 

With TUIQP TEa, the method was evaluated (Fig. 1), and 
showed good performance of 4 Sigma for the H Ul level in two 
laboratories, marginal performance of 3 Sigma on the M-H Ul 
level in one laboratory, and poor performance of 2 Sigma on the 
M-H Ul level in two laboratories. However, the remaining results 
were in the unacceptable performance region of 1 Sigma. The 
low Sigma metrics obtained by Lab D might also be contributed 
from the high CV owing to the small number of sample repli- 
cates. The method performance was evaluated using EQUIP 
TEa (Fig. 2). The critical medical decision level of 100 pg/L for 
adequate iodine nutrition, covered by the M range; accordingly, 
the unacceptable performance of<2 Sigma by all laboratories 
was not satisfactory. Performance of 4 Sigma requires quadru- 
plicate IQC with application of multi-rule or single-rule of 2.5 sec 
to detect errors. Performance with less than 4 Sigma should be 
improved by applying as many IQCs as possible, and maximum 
care should be taken for improvement on the human resource 
skills to achieve competency, critical instrument maintenance 
(e.g., micropipettes), and a laboratory strategy plan for quality 
control [12]. 

In conclusion, the UIMM performance should be improved to 
achieve stricter TEaS. Application of the multi-rule IQC verifica- 
tion in the IQC planning is necessary to improve the perfor- 
mance. It is helpful to determine Sigma quality methcs for fu- 
ture QC management plans in the Ul laboratory. 
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